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(57) [Abstract] 

[Object] To ensure dynamic optimization of distribution of 
traffic in a plurality of paths in a network. 
[Solution] A flow classifying unit 1 classifies flows of 
input packets into respective groups based on preset 
weighting factors thereof, and flow output units 2, 3 
output the flows to different paths for the groups. A 
bandwidth measuring unit 4 measures that of bandwidths used 
in the bandwidths which is used by each flow group by group, 
and a unit bandwidth calculator 5 calculates a unit use 
bandwidth for each group by dividing the measured use 
bandwidth of each group by a weighting factor previously 
assigned to the group. A weighting factor adjusting unit 6 
adjusts the weighting factor of each group based on the 
unit use bandwidth of each group. 

[Scope of Claims for Patent] 

[Claim 1] A path control method for use in a path control 
apparatus that is connected to a packet transfer network, 
identifies a flow to which an input packet belongs from an 
attribute thereof, and outputs the packet to one of paths 
with the flow as a unit, comprising: 



a step of classifying a flow of an input packet to one 
of groups based on a preset weighting factor of each group; 

a step of outputting flows of the groups to different 
paths for the groups; 

a step of measuring bandwidths used in the paths group 

by group ; and 

a step of adjusting the weighting factor of each group 
based on a ratio of the measured bandwidths. 
[Claim 2] The path control method according to claim 1, 
further comprising a step of calculating a unit use 
bandwidth for each of the groups by dividing each measured 
bandwidth by a weighting factor previously assigned to the 
group , and 

wherein at a time of adjusting the weighting factors, 
the weighting factor of each group is adjusted based on 
each unit use bandwidth. 

[Claim 3] The path control method according to claim 2, 
wherein at a time of adjusting the weighting factors, the 
weighting factors are changed in a way as to average the 
unit use bandwidth of each group. 

[Claim 4] The path control method according to claim 2, 
wherein at a time of adjusting the weighting factors, when 
the unit use bandwidth of the group is greater than the 
bandwidth of another group, the weighting factor of the 
former group is increased, and when the unit use bandwidth 
of the group is smaller than the bandwidth of another group, 
the weighting factor of the former group is decreased. 
[Claim 5] The path control method according to claim 1, 
wherein at a time of adjusting the weighting factors, the 
weighting factors are adjusted in a way that a ratio of the 
weighting factors of the groups becomes equal to a ratio of 
the bandwidths . 



[Claim 6] The path control method according to claim 1, 
wherein at a time of classifying the flows, classification 
is performed in a way that the number of flows to be 
classified into each group is proportional to the 
associated weighting factor. 

[Claim 7] The path control method according to claim 1, 
wherein at a time of classifying the flows, a connection of 
a fourth layer of an OSI reference model is used as each 
flow . 

[Claim 8] The path control method according to claim 1, 
wherein at a time of classifying the flows, a sequence of 
input packets having at least one of a sender address or a 
destination address of a third layer of an OSI reference 
model identical are taken as a same flow. 
[Claim 9] The path control method according to claim 1, 
wherein at a time of classifying the flows, hash values of 
input packets are calculated from a hash function including 
at least one of a sender address, a destination address, a 
sender port number and a destination port number of an 
input packet as an argument, and those input packets whose 
hash values obtained are identical are classified into a 
same group. 

[Claim 10] The path control method according to claim 1, 
wherein at a time of classifying the flows, a flow storage 
table which stores flows of classified input packets is 
used, when a new input packet belongs to any flow stored in 
the flow storage table, the input packet is classified into 
the same group as the flow, and when the input packet 
belongs to a new flow which is not stored in the flow 
storage table, the new flow is classified into that of the 
groups whose weighting factor is to be increased. 



[Claim 11] The path control method according to claim 1, 
wherein as the path, a path which is distinguished based on 
LSP of MPLS is used. 

[Claim 12] The path control method according to claim 1, 
5 wherein as the path, a path which is distinguished based on 
a virtual connection of PPP is used.. 

[Claim 13] The path control method according to claim 1, 
wherein as the path, a path which is distinguished based on 
a virtual connection VC or a virtual path VP of ATM is used. 
10 [Claim 14] The path control method according to claim 1, 

wherein as the path, a path which is distinguished based on 
VLAN defined in IEEE 802 . 1Q is used. 

[Claim 15] The path control method according to claim 1, 
wherein as the path, a path which is distinguished based on 
15 a node of a next hop of the path control apparatus is used. 
[Claim 16] A path control apparatus that is connected to a 
packet transfer network, identifies a flow to which an 
input packet belongs from an attribute thereof, and outputs 
the packet to one of paths with the flow as a unit, 
20 comprising: 

a flow classifying unit that classifies a flow of an 
input packet to one of groups based on a preset weighting 
factor of each group; 

a flow output unit that outputs flows of the groups to 
25 different paths for the groups ; 

a bandwidth measuring unit that measures bandwidths 
used in the paths group by group; and 

a weighting factor adjusting unit that adjusts the 
weighting factor of each group based on a ratio of the 
30 measured bandwidths of the groups measured by the bandwidth 
measuring unit. 

[Claim 17] The path control apparatus according to claim 16, 
further comprising a unit bandwidth calculator that 
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calculates a unit use bandwidth for each of the groups by 
dividing each bandwidth measured by the bandwidth measuring 
unit by a weighting factor previously assigned to the group, 
and 

5 wherein the weighting factor adjusting unit adjusts 

the weighting factor of each group based on each unit use 
bandwidth calculated by the unit bandwidth calculator. 
[Claim 18] The path control apparatus according to claim 17, 
wherein the weighting factor adjusting unit changes the 
10 weighting factors in a way as to average the unit use 
bandwidth of each group. 

[Claim 19] The path control apparatus according to claim 17, 
wherein when the unit use bandwridth of the group is greater 
than the bandwidth of another group, the weighting factor 
15 adjusting unit increases the weighting factor of the former 
group, and when the unit use bandwidth of the group is 
smaller than the bandwidth of another group, the weighting 
factor adjusting unit decreases the weighting factor of the 
former group . 

20 [Claim 20] The path control apparatus according to claim 16, 
wherein the weighting factor adjusting unit adjusts the 
weighting factors in a way that a ratio of the weighting 
factors of the groups becomes equal to a ratio of the 
bandwidths . 

25 [Claim 21] The path control apparatus according to claim 16, 
wherein the flow classifying unit performs classification 
in a way that the number of flows to be classified into 
each group is proportional to the associated weighting 
factor . 

30 [Claim 22] The path control apparatus according to claim 16, 
wherein the flow classifying unit uses a connection of a 
fourth layer of an OSI reference model as each flow. 



5 



[Claim 23] The path control apparatus according to claim 16, 
wherein the flow classifying unit takes a sequence of input 
packets having at least one of a sender address or a 
destination address of a third layer of an OSI reference 
model identical as a same flow. 

[Claim 24] The path control apparatus according to claim 16, 
wherein the flow classifying unit includes a hash 
calculator that calculates hash values of input packets 
from a hash function including at least one of a sender 
address, a destination address, a sender port number and a 
destination port number of an input packet as an argument, 
and a hash value group classifying unit that classifies 
those input packets whose hash values obtained are 
identical into a same group. 

[Claim 25] The path control apparatus according to claim 16, 
wherein the flow classifying unit has a flow storage table 
which stores flows of classified input packets, when a new 
input packet belongs to any flow stored in the flow storage 
table, the flow classifying unit classifies the new input 
packet into the same group as the flow, and when the input 
packet belongs to a new flow which is not stored in the 
flow storage table, the flow classifying unit classifies 
the new flow into that of the groups whose weighting factor 
is to be increased. 

[Claim 26] The path control apparatus according to claim 16, 
wherein as the path, a path which is distinguished based on 
LSP of MPLS is used. 

[Claim 27] The path control apparatus according to claim 16, 
wherein as the path, a path which is distinguished based on 
a virtual connection of PPP is used. 

[Claim 28] The path control apparatus according to claim 16, 
wherein as the path, a path which is distinguished based on 
a virtual connection VC or a virtual path VP of ATM is used. 



[Claim 29] The path control apparatus according to claim 16 , 
wherein as the path, a path which is distinguished based on 
VLAN defined in IEEE 802. 1Q is used. 

[Claim 30] The path control apparatus according to claim 16, 
5 wherein as the path, a path which is distinguished based on 
a node of a next hop of the path control apparatus is used. 

[Detailed Description of the Invention] 
[0001] 

10 [Technical Field of the Invention] 

The present invention relates to a path control method 
and apparatus, and more particularly, to a path control 
method and apparatus that dynamically distribute a load to 
a plurality of paths in a packet transport network. 

15 [0002] 

[Conventional Technique] 

Although there is a significant improvement on the 
speed of an access line in recent communication environment, 
i.e., the transmission speed between a service subscriber 

20 terminal and a nearby subscriber holding apparatus, an 

improvement on the speed of the core network of a carrier 
is delayed due to various factors, and the bandwidths of a 
network core can easily be used up by the traffic of a 
small number of users. 

25 [0003] To improve the utilization factor of network 

resources in such a situation, the field of traffic 
engineering (hereinafter, TE: Traffic Engineering) has been 
studied actively in recent years. While the packet 
transfer along the path (the shortest path) which involves 

30 the lowest cost at an end point was the main stream in the 
conventional IP network, the TE aims at avoiding that a 
load focuses on a specific relay line, thereby improving 
the utilization factor of network resources by allowing the 
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path with the second and third lowest costs to participate 
in packet transfer. 

[0004] In the TE, for example, the necessary bandwidth 

of the circuit that connects each base of a user is 
estimated by the measurement on the network side, or the 
demand from the user, and calculation for optimization of 
the path to be assigned to the circuit is performed so that 
network resources can be used most efficiently. However, 
this calculation is complicated, and takes a long time to 
acquire the optimal solution in a large network. As a 
result, it is not rare that changing the setting of a path 
accompanying a change in traffic takes several days or more. 
The method of optimizing the network resources over a long 
period of time is hereinafter called as static TE . 

[0005] The traffic with a high burst to multiple 

unspecified persons is rapidly increasing as traffic of the 
Internet due to the aforementioned improvement on the speed 
of the access line. That is, unlike the conventional 
dedicated line or a telephone, a communication party is not 
fixed and what is more, there is a large difference in use 
bandwidth between the time of data transfer and the time of 
not transferring data. With the conventional static TE 
alone, therefore, it is difficult to efficiently use 
network resources for the traffic for which a path and a 
use bandwidth are changed sharply for a short time. There 
is a strong demand for a method which is sensitively 
responsive to a short-time change and optimizes resources. 
Such a method is called hereinafter as dynamic TE . 

[0006] 

[Problems to be Solved by the Invention] 

However, such dynamic TE has a problem that the 
conventional load distribution method is not applicable. 
Next, the technical problem at the time of applying the 
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conventional load distribution method to the dynamic TE is 
explained. Execution of the TE generally involves three 
stages, (1) measuring the load of each path in a network, 
i.e., the degree of utilization, (2) analyzing the 
5 measuring result and performing calculation to optimize 
allocation of resources, and (3) transferring traffic 
through a new path based on the calculation result. 
[0007] Measurement of the load (1) in an IP network is 

generally carried out by remotely acquiring information 

10 from a server that monitors load information with respect 
to each path control apparatus to be monitored using SNMP 
(Simple Network Management Protocol) . However, applying 
this method to the dynamic TE has many technical problems. 
The following will describe problems at the time of 

15 collecting load information in case of using SNMP as an 
example. First, it is difficult to handle an overloaded 
link and a shaper. When an overloaded link (link which has 
used up the physical speed) or a shaper (apparatus that 
shapes traffic to a fixed bandwidth) is present in a path, 

20 information is insufficient if the flow rate of the link is 
merely acquired as load information. That is, with the 
maximum speed used up, information as to how much it is 
actually overloaded and how many traffics should be 
distributed to other paths is not acquired. 

25 [0008] To solve this problem strictly, it is necessary 

to measure the difference between the input bandwidth and 
the output bandwidth of each path control apparatus with 
respect to each path. What is more, the path control 
apparatus generally has a plurality of input interfaces and 

30 output interfaces, and traffic repeats meeting and parting 
in a plurality of path control apparatuses, so that it is 
necessary to investigate not only the amount of traffic 
which merges after passing through all paths but also the 
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path control tables in the path control apparatuses in 
order to investigate the cause of the congestion at a 
certain link. It is however extremely difficult to collect 
and analyze those pieces of information at a high speed. 
5 Even an overloaded link or a shaper is present in a path, 
therefore, a simple and effective method of estimating the 
degree of load and the necessary amount of distribution to 
other paths is required. 

[0009] Secondly, due to the provision of the server, a 

10 new complication is increased. Dynamic load distribution 
requires that load information be collected from time to 
time in a cycle of several seconds. In collecting load 
information frequently in a large network, it is. more 
efficient for an exclusive server that gathers load 
15 information to collectively gather information than path 
control apparatuses individually performing measurement, 
analysis and the like. This however brings up a new 
complication to the configuration of a network. For 
example, it is necessary to take into consideration the 
20 setting of a separate circuit for load information, double 
circuit configuration therefor, double server configuration 
and the like. There is a strong demand for an efficient 
information collecting method which does not use such a 
server . 

25 [0010] Thirdly, there is an increase in the number of 

management targets. To bypass each path appropriately, it 
is necessary to measure the load for every path with 
respect to all the path control apparatuses in a network. 
Since the number of paths and the number of path control 

30 apparatuses increase drastically in a large network, 
however, it is difficult to perform measurements at 
individual en-route points in these paths, and to analyze 
the results. This results in long calculation required for 
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optimization in response to a change in load, making 
adaptation to the dynamic TE difficult. A method of 
effectively performing load distribution with fewer 
management targets is required. 
5 [0011] Fourthly, there is a difficulty in attending to a 

failure. The dynamic TE is demanded of the capability 
which spontaneously copes with a failure in a network. 
Thereforie, when there is little traffic in a certain path, 
it is necessary to find quickly out whether the cause is a 

10 failure in a link or a failure in path control, or is 

simply from vacancy. When it is vacant, it is preferable 
to actively let flows to flow there, whereas when a failure 
has occurred in a path, it is desirable not to use the path. 
[0012] However, it is difficult to determine such a 

15 failure using SNMP alone in an actual network. When the 
repeater and switch that do not have the management 
function of the SNMP are present on a path, for example, 
the failure produced in that part cannot be detected. 
Moreover, the cause of a failure is not just a failure in 

20 an interface, but various elements, such as generation of a 
loop in the transitional condition of path control, are 
possible. Therefore, accurate detection of a failure on 
path control requires acquisition of path control 
information held in each path control apparatus 

25 (information which is exchanged by the path control 
protocol) and a path control table in addition to 
monitoring the statuses of all the elements associated with 
packet transfer including such a repeater and a switch. 
[0013] What is making the problems more difficult is 

30 that a plurality of path control protocols are used in the 
same network. That is, since it is common to use manual 
static setting of a path and setting of a path using 
dynamic path control protocols, such as OSPF (Open Shortest 



11 



Path First) and RIP (Routing Information Protocol) , 
together, it is necessary to collect information for all of 
the static or dynamic path settings with the optimal method, 
and to perform mutual conversion thereof and systematic 
5 analysis thereof in order to detect a failure in path 
control. For example, it is necessary to acquire 
information representing a link status for OSPF, and check 
up/down information for adjoining path control apparatuses 
and from which adjoining apparatus a path is learned for 
10 RIP. Even when a failure occurs in a network, therefore, a 
method of detecting the failure promptly and optimizing a 
path is required. 

[0014] As apparent from the above, there are many 

matters in applying the conventional load distribution 

15 method to the dynamic TE , and it is difficult to 

dynamically optimize paths in a network on the practical 
level. The present invention is to solve such a problem, 
and aims to provide a path control method and apparatus 
that can dynamically optimize distribution of traffic over 

20 a plurality of paths in a network. 
[0015] 

[Means for Solving Problem] 

To achieve the object, a path control method according 
to the present invention is a path control method for use 

25 in a path control apparatus that is connected to a packet 
transfer network, identifies a flow to which an input 
packet belongs from an attribute thereof, and outputs the 
flow to one of paths with the flow as a unit, comprising: a 
step of classifying a flow of an input packet to one of 

30 groups based on a preset weighting factor of each group; a 
step of outputting flows of the groups to different paths 
for the groups; a step of measuring bandwidths used in the 
paths group by group; and a step of adjusting the weighting 
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factor of each group based on a ratio of the measured 
bandwidths . 

[0016] A step of calculating a unit use bandwidth for 

each of the groups by dividing each measured bandwidth by a 
weighting factor previously assigned to the group can 
further be provided, and at a time of adjusting the 
weighting factors, the weighting factor of each group can 
be adjusted based on each unit use bandwidth. 
[0017] At a time of adjusting the weighting factors, the 
weighting factors can be changed in a way as to average the 
unit use bandwidth of each group. In addition, when the 
unit use bandwidth of the group is greater than the 
bandwidth of another group, the weighting factor of the 
former group can be increased, and when the unit use 
bandwidth of the group is smaller than the bandwidth of 
another group, the weighting factor of the former group can 
be decreased. At a time of adjusting the weighting factors, 
the weighting factors can be adjusted in a way that a ratio 
of the weighting factors of the groups becomes equal to a 
ratio of the bandwidths . 

[0018] At a time of classifying the flows, 

classification can be performed in a way that the number of 
flows to be classified into each group is proportional to 
the associated weighting factor. In addition, a connection 
of a fourth layer of an OSI reference model can be used as 
each flow, or a sequence of input packets having at least 
one of a sender address or a destination address of a third 
layer of an OSI reference model identical can be taken as a 
same flow. 

[0019] At a time of classifying the flows, hash values 

of input packets can be calculated from a hash function 
including at least one of a sender address, a destination 
address, a sender port number and a destination port number 



of an input packet as an argument, and those input packets 
whose hash values obtained are identical can be classified 
into a same group, or a flow storage table which stores 
flows of classified input packets can be used, when a new 
input packet belongs to any flow stored in the flow storage 
table, the input packet can be classified into the same 
group as the flow, and when the input packet belongs to a 
new flow which is not stored in the flow storage table, the 
new flow can be classified into that of the groups whose 
weighting factor is to be increased. 

■ 

[0020] As the path, a path which is distinguished based 

on LSP of MPLS can be used. In addition, a path which is 
distinguished based on a virtual connection of PPP , a path 
which is distinguished based on a virtual connection VC or 
a virtual path VP of ATM, a path which is distinguished 
based on VLAN defined in IEEE 802. 1Q, or a path which is 
distinguished based on a node of a next hop of the path 
control apparatus can be used . 

[0021] A path control apparatus according to the present 

invention is a path control apparatus that is connected to 
a packet transfer network, identifies a flow to which an 
input packet belongs from an attribute thereof, and outputs 
the flow to one of paths with the flow as a unit, 
comprising: a flow classifying unit that classifies a flow 
of an input packet to one of groups based on a preset 
weighting factor of each group; a flow output unit that 
outputs flows of the groups to different paths for the 
groups; a bandwidth measuring unit that measures bandwidths 
used in the paths group by group; and a weighting factor 
adjusting unit that adjusts the weighting factor of each 
group based on a ratio of the measured bandwidths of the 
groups measured by the bandwidth measuring unit. 



[0022] A unit bandwidth calculator that calculates a 
unit use bandwidth for each of the groups by dividing each 
bandwidth measured by the bandwidth measuring unit by a 
weighting factor previously assigned to the group can 
5 further be provided, and the weighting factor adjusting 

unit can adjust the weighting factor of each group based on 
each unit use bandwidth calculated by the unit bandwidth 
calculator. 

[0023] The weighting factor adjusting unit can change 

10 the weighting factors in a way as to average the unit use 
bandwidth of each group. In addition, when the unit use 
bandwidth of the group is greater than the bandwidth of 
another group, the weighting factor adjusting unit can 
increase the weighting factor of the former group, and when 
15 the unit use bandwidth of the group is smaller than the 

bandwidth of another group, the weighting factor adjusting 
unit can decrease the weighting factor of the former group. 
The weighting factor adjusting unit can adjust the 
weighting factors in a way that a ratio of the weighting 
20 factors of the groups becomes equal to a ratio of the 
bandwidths . 

[0024] The flow classifying unit can perform 

classification in a way that the number of flows to be 
classified into each group is proportional to the 

25 associated weighting factor. In addition, the flow 

classifying unit can use a connection of a fourth layer of 
an OSI reference model as each flow, or the flow 
classifying unit can take a sequence of input packets 
having at least one of a sender address or a destination 

30 address of a third layer of an OSI reference model 
identical as a same flow. 

[0025] At a time the flow classifying unit classifies 

the flows, a hash calculator can calculate hash values of 
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input packets from a hash function, including at least one 
of a sender address, a destination address, a sender port 
number and a destination port number of an input packet as 
an argument, .and a hash value group classifying unit can 
5 classify those input packets whose hash values obtained are 
identical into a same group. 

[0026] The flow classifying unit can have a flow storage 

table which stores flows of classified input packets, when 
a new input packet belongs to any flow stored in the flow 

10 storage table, the flow classifying unit can classify the 
new input packet into the same group as the flow, and when 
the input packet belongs to a new flow which is not stored 
in the flow storage table, the flow classifying unit can 
classify the new flow into that of the groups whose 

15 weighting factor is to be increased. 

[0027] As the path, a path which is distinguished based 

on LSP of MPLS can be used. In addition, a path which is 
distinguished based on a virtual connection of PPP, a path 
which is distinguished based on a virtual connection VC or 

20 a virtual path VP of ATM, a path which is distinguished 
based on VLAN defined in IEEE 802. 1Q, or a path which is 
distinguished based on a node of a next hop of the path 
control apparatus can be used. 
[0028] 

25 [Embodiments of the Invention] 

Exemplarily embodiments of the present invention will 
be explained below in detail with reference to the 
accompanying drawings. Fig. 1 is a schematic configuration 
diagram of a packet transfer network to which a path 

30 control method according to one embodiment of the present 
invention is adapted. A packet transfer network Nil 
includes a single load balancer Bll having a path control 
apparatus that employs the path control method according to 
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one embodiment of the present invention, and three routers 
Rll, R12, R13, which are connected to one another by- 
transmitting units Lll. The routers Rll, R12 , R13 are 
general units that transfer packets, and switches, hubs, 
5 repeaters, packet exchangers or the like can be used as the 
routers. While the use of three routers is taken as an 
example hereinafter, an arbitrary number of routers can be 
used. 

[0029] A plurality of terminals Til, T12 are connected 

10 to the load balancer Bll via the transmitting units Lll. 
While the use of one load balancer Bll is taken as an 
example hereinafter, an arbitrary number of load balancers 
can be used. Although the load balancer Bll is directly 
connected to the terminals Til, T12 by transmitting units 

15 Lll, an arbitrary number of routers or networks can be 

present between both. The load balancer Bll does not need 
to be provided at an entry point of the network as in Fig. 
1, but can be incorporated in, for example, the terminals 
Til, T12 or the routers Rll, R12 . 

20 [0030] Not all of the transmitting units Lll should be 

identical, and different techniques can be used for the 
transmitting unit that connects Til to Bll and for the 
transmitting unit that connects Bll to Rll. In addition, 
although not shown, a very large number of terminals can be 

25 connected to the packet transfer network Nil via other load 
balancers and routers, and the amount of traffic that flows 
through the individual parts in the network Nil can vary 
from time to time. 

[0031] Fig. 2 is a concept diagram of a plurality of 

30 paths in a case that packets are transferred to a terminal 
T13 via the load balancer Bll with the terminals Til and 
T12 as senders. In Fig. 1, there are multiple paths 
possible that run toward the terminal T13 from the load 
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balancer Bll via the routers Rll, R12, R13. For easier 
understanding, a case that two packets paths Pll, P12 are 

used will be considered. A path of load balancer Bll — > 

router Rll — > router R13 — » terminal T13 is used as the 

5 path Pll, and a path of load balancer Bll — > router R12 — > 

router R13 -» terminal T13 is used as the path P12. 
[0032] The packets output from the paths Pll, P12 

terminals Til, T12 reach the terminal T13 passing through 
either the path Pll or the path P12 while repeating meeting 

10 and parting to and from traffic from other terminals. As 
the loads on the routers Rll, R12 and on the transmitting 
units Lll in the path change from time to time, the target 
of the load balancer Bll is to transfer traffic to the 
paths Pll, P12 in a way that the utilization factor of the 

15 network resources becomes highest according to the present 
invention the loads on the paths . 

[0033] Fig. 3 is a block diagram of a configuration 

example of the load balancer Bll. The load balancer Bll 
includes a flow classifying unit 1, flow output units 2, 3, 

20 a bandwidth measuring unit 4, a unit bandwidth calculator 5, 
and a weighting factor adjusting unit 6. The load balancer 
Bll manages packets having the same attribute as a single 
flow based on information which uses the attributes of a 
packet to be input, such as a sender address, a destination 

25 address, a sender port number, and a destination port 

number, singularly or in combination. The load balancer 
Bll controls distribution of loads on the paths by 
classifying those flows into a plurality of groups, and 
adjusting the bandwidths of the paths to be used in the 

30 groups. 

[0034] The flow classifying unit 1 is a functional unit 

that classifies flows to which input packets belong into 
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individual groups based on weighting factors preset for 
respective groups. The flow output unit 2, 3 is a 
functional unit that is provided for the respective path 
Pll, P12 and outputs flows, classified into each group by 
5 the flow classifying unit 1, to the associated path group 
by group. The bandwidth measuring unit 4 is a functional 
unit that measures the bandwidth the group uses in each 
path. 

[0035] The unit bandwidth calculator 5 is a functional 

10 unit that divides the use bandwidth of each group measured 
by the bandwidth measuring unit 4 by the weighting factor 
of the group to calculate the unit use bandwidth per 
weighting factor of each group. The weighting factor 
adjusting unit 6 is a functional unit that adjusts the 
15 weighting factor of each group in a way that the unit use 
bandwidth of each group calculated by the unit bandwidth 
calculator 5 is averaged. Each of those functional units 
can be configured by cooperation of hardware that includes 
a microprocessor like a CPU, and a peripheral circuit, and 
20 software that is executed by the microprocessor, or can be 
configured only by hardware circuits. 

[0036] As an example, the following will describe a case 
that flows are classified into two groups Gil and G12, 
flows of the group Gil are output to the path Pll from the 

25 flow output unit 2, and flows of the group G12 are output 
to the path P12 from the flow output unit 3. 
[0037] Fig. 4 is a flowchart of a path control process 

in the load balancer. Packets input from the terminals Til, 
T12 are classified into the groups Gil, G12 based on the 

30 weighting factors of the groups (step 100) . The 

classification method is such that, for example, the number 
of flows to be classified into each group is proportional 
to the weighting factor. Fig. 3 is an example where the 
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number of input flow is 6, and weighting factors Wll, W12 
of the groups Gil, G12 are 1 and 2, respectively. This 
classification method classifies two of the input flows 
into the group Gil, and the other four into the group G12. 
5 [0038] The groups Gil, G12 are respectively output to 

the paths Pll, P12 by the flow output units 2, 3 (step 101) . 
The unit use bandwidths of the flows of the packets output 
to the paths Pll, P12 are measured from time to time for 
each group by the bandwidth measuring unit 4 (step 102) . 

10 Based on the measured results, the bandwidth per unit 
weighting factor is calculated (step 103) . When the 
measured unit use bandwidths in the groups Gil, G12 are 
respectively 10 and 12, for example, dividing the values by 
the corresponding weighting factors 1 and 2 yields the unit 

15 use bandwidths of 10 and 6 per unit weighting factor, 
respectively . 

[0039] Based on the unit use bandwidth for each group 

calculated by the unit bandwidth calculator 5, the 
weighting factor adjusting unit 6 adjusts the weighting 

20 factor of each group (step 104). Therefore, when the flow 
classifying unit 1 reclassifies the flows or classifies new 
flows thereafter, the process returns to step 100 where the 
* weighting factor adjusted by the weigrhting factor adjusting 
unit 6 will be used, thus averaging the bandwidths to be 

25 used by flows passing through each path. This dynamically 
optimizes the distribution of traffic in a plurality of 
paths in the network. Accordingly, the utilization factor 
of the network resources for traffic with high burst is 
improved, making it possible to provide many clients with a 

30 low-cost packet transfer capability. 

[0040] The present invention has an aspect of providing 

a packet transfer method which dynamically changes the 
transfer path according to the present invention 
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corresponding to the load condition of the network. There 
is a specific example of a case that paths belonging to the 
same TCP connection are considered as flows. The traffics 
are classified in a way that the ratio of the numbers of 
5 TCP connections included in the groups becomes equal to the 
ratio of the numbers of weighting factors assigned to the 
groups, are respectively sent to different paths, the use 
bandwidths of the groups sent to the paths are measured 
group by group, and the measured use bandwidths are divided 

10 by the weighting factor of the group, thereby optimizing 

the number of weighting factors in a way that the unit use 
bandwidths per weighting factor among the groups become 
equal. Accordingly, even when a link or a shaper which 
uses up the physical bandwidth is present on a path, the 

15 throughputs of the TCP sessions that pass through the paths 
are quantitatively compared with each other to be optimized. 
This can overcome the first problem. 

[0041] As each load balancer can execute the measurement 

and the calculation for optimization independently without 

20 using information about a' load or a failure from other load 
balancers or routers, providing a server that is the second 
problem is unnecessary. As each load balancer can 
internally measure and process the use bandwidth of each 
group only for those flows which pass the load balancer, it 

25 is unnecessary to collect information on all pass points of 
all the paths over the entire network. The number of 
measurement targets becomes smaller as compared with the 
conventional method, and the measuring process is 
distributed to multiple load balancers, thereby overcoming 

30 the third problem. 

[0042] The method also overcomes the fourth problem. 

This utilizes that a transport layer protocol, such as TCP, 
generally has a congestion control function. For example, 
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a terminal that performs communications using TCP 
dynamically changes the use bandwidth of a connection 
according to the quality of the network. When a failure or 
congestion occurs in the communication path, the 
5 transmission speed is automatically reduced, whereas when 
the communication path is empty, the transmission speed is 
automatically increased . 

[0043] The present invention, unlike conventional 

examples, does not measure the use bandwidth of each path; 

10 but calculates the use bandwidth per unit weighting factor 
or the unit use bandwidth, which is a use bandwidth per TCP 
connection. When the unit use bandwidth among multiple 
paths are compared with one another and the unit use 
bandwidth is extremely small, it is considered that some 

15 sort of failure has occurred, and when the unit use 

bandwidth is increased, it is understood that the path is 
empty. This makes it possible to grasp whether a decrease 
in traffic in a path is originated from a failure in link 
or simply from the path being empty, so that distribution 

20 can be done in a short period of time. 

[0044] Although the bandwidth measuring unit 4 measures 

the use bandwidth based on the outputs of the flow output 
units 2, 3, the use bandwidth can be measured from the 
output of the flow classifying unit 1 because the groups 

25 Gil, G12 correspond in one to one to the paths Pll, P12. 

Although the path control process has been explained as a 
sequence of flow processes referring to Fig. 4, the 
individual steps in the path control process can be 
executed singularly. Particularly, the measuring interval 

30 in the bandwidth measuring unit 4 can be periodic or can be 
changed intentionally. Alternatively, the measurement can 
be executed as needed. 
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[0045] The weighting factor adjusting method in the 
weighting factor adjusting unit 6 is explained with 
reference to Fig. 5. Fig. 5 is an explanatory diagram of 
an adjustment example for weighting factors. Given that 
5 the weighting factors of the groups Gil, G12 are weighting 
factors Wll and W12, and the unit use bandwidths per unit 
weighting factor are BW11 and BW12 , the weighting factor 
adjusting unit 6 changes the weighting factors Wll, W12 
according to the sizes of the unit use bandwidths BW11, 
10 BW12. When BW11>BW12, Wll is increased and W12 is 

decreased, and when BW1 KBW12 , Wll is decreased and W12 is 
increased. When BW11 is equal to BW12, the values of Wll 
and W12 does not need to be changed. 

[0046] The adjustment of the weighting factors Wll, W12 

15 in a way as to be proportional to the number of flows 

included in each group Gil, G12 increases the number of 
flows that pass through the path Pll and decreases the 
number of flows that pass through the path P12. Therefore, 
the system changes in the direction of making the bandwidth 

20 per flow uniform. With regard to the weighting factor 
adjusting method, the degrees of adjustment of the 
weighting factors Wll, W12 can be changed according to the 
levels of the absolute values of unit use bandwidths BW11, 
BW12 or the level of the difference therebetween. 

25 [0047] In the above description, a concept of a unit use 

bandwidth per unit weighting factor with respect to each 
path has been introduced. However, when control to make 
the unit use bandwidth of each path uniform is executed in 
step 104 (see Fig. 4) of adjusting the weighting factor, it 

30 is possible to take a structure that eliminates step 103 of 
calculating the unit use bandwidth per weighting factor. 
In this case, in step 104,* taking the use bandwidth of each 
path measured in step 102 as an input variable, the 
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weighting factors should be adjusted in a way that the 
ratio of the weighting factors for the paths becomes equal 
to the ratio of the use bandwidth of the path. 
[0048] The use of this structure can likewise eliminate 

5 the unit bandwidth calculator 5 in Fig. 3 in which case the 
weighting factor adjusting unit 6 receives the use 
bandwidths of the paths, measured by the bandwidth 
measuring unit 4, as inputs, and outputs those weighting 
factors which are equal to the ratio of the use bandwidths 

10 of the paths. By way of a specific example for explanation, 
when the measured use bandwidths of the paths Pll, P12 are 
respectively 10 and 12, for example, connections should be 
classified by the ratio of 10:12 with respect to the paths 
Pll, P12 to equalize the bandwidth per connection. 

15 [0049] It is to be noted however that the movement of 

connections between paths this way can cause the use 
bandwidths in Pll and P12 to change from the initial 10:12, 
or can make the system unstable. Therefore, adjustment of 
weighting factors can be gradually changed in multiple 

20 separate times according to the use bandwidths that are 

acquired from time to time. Alternatively, for the purpose 
of accelerating the convergence speed, the amount of a 
change in weighting factor can be intentionally increased 
in consideration of a change in bandwidth after changing 

25 the weighting factor. 

[0050] The flow classification method in the flow 

classifying unit 1 will be explained next with reference to 
Figs. 6 and 7. Figs. 6 and 7 are examples of the flow 
classification method. In the flow classification method 

30 in Fig. 6, the fourth layer connection of the OSI reference 
model is taken as a flow. As an attribute for 
classification, TCP (Transmission Control Protocol) is used 
as an example of the fourth layer protocol. In this case, 
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one connection of the TCP corresponds to one flow. The TCP 
has a congestion control function and a flow control 
function, and given that the amount of data and external 
conditions, such as delay and packet loss, are the same, 
5 the bandwidths of the individual connections tend to be 
equal. Therefore, adjusting Wll, W12 in a way as to 
equalize BW11 and BW12 in the above-described manner 
changes the system in the direction of averaging all the 
bandwidths of the TCP connections that pass through both 
10 paths Pll, P12. This improves the resource utilization 
efficiency over the entire network. 

[0051] In the flow classification method in Fig. 7, a 

sequence of packets in which at least the sender or 
destination address of the third layer of the OSI reference 

15 model is the same is taken as a flow. As an attribute for 

classification, IP is used as an example of the third layer. 
In this case, the load for identifying flows can be made 
smaller as compared with the way of identifying flows 
according to the fourth layer protocol. This is because 

20 while four numerals, a sender IP address, a destination IP 

address, a sender port number and a destination port number, 
are generally needed to identify a TCP connection, the case 
of Fig. 7 requires the sender IP address only. In this 
example, the system changes in a way that the bandwidth per 

25 sender address becomes uniform in two paths. When TCP is 
used as the fourth layer protocol and sender IP addresses 
use about the same number of TCP connections on average, 
for example, the bandwidths to be used by terminals of the 
sender IP addresses become equal. 

30 [0052] The methods shown in Figs. 6 and 7 need to check 

to which flow belongs every packet that passes through the 
load balancer based on the attribute of the packet, and 
store it. However, the essential requirement in the 
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embodiment is to classify input flows to Gil and G12 by the 
ratio proportional to the ratio of weighting factors, 
W11:W12. To achieve the object, a hash function can be 
used. Fig. 8 is an example of the configuration of the 
5 flow classifying unit 1 that uses a hash function which has 
the sender address, the destination address, the sender 
port number and the destination port number as arguments 
and integers of 1 to 9 as a value range, and includes a 
hash value calculator 21 and a hash value group classifying 
10 unit 22. 

[0053] An available hash function is such that the 

numbers of flows included in individual minute portions of 
the value of the hash function become equal to one another. 
One example of such a hash function is a function of 

15 " (sender address + destination address + sender port number 
+ destination port number) mod9 + 1" (AmodB indicating the 
remainder of A divided by B) . When the hash value 
calculator 21 calculates the hash function for the packets, 
integers of 1 to 9 are obtained as hash values. In case of 

20 the Internet that has a sufficiently large number of flows, 
the numbers of flows that take the individual hash values 
become approximately equal. To finely adjust the 
proportion of flow classification, the number of divisions 
in the function, 9, should be made larger. The hash value 

25 group classifying unit 22 divides the value range to the 
previous ratio of W11:W12 to be respectively associated 
with the groups Gil, G12. This can allow input flows to be 
classified by an arbitrary ratio as a consequence. The 
method has an advantage that it is unnecessary to store 

30 flows which pass through the load balancer. 

[0054] Distinction of paths is explained below. The 

present embodiment requires that a plurality of paths be 
set for the same destination in the packet transfer network 
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Nil. In the conventional Internet, because packets for the 
same destination pass through the same path, paths should 
be distinguished by somehow. As an example of a method 
available for the purpose, paths can be distinguished based 
5 on LSP (Label Switched Path) of MPLS (Multi Protocol Label 
Switching) , a virtual connection of PPP (Point- to-Point 
Protocol) , a virtual connection of a frame relay, a virtual 
path VP (Virtual Path) of ATM (Asynchronous Transfer Mode) , 
a virtual channel VC (Virtual Connection) , VLAN (Virtual 

10 Bridged Local Area Networks) of IEEE 802. 1Q, a node 

(physical interface) of a next hop, a radio channel or 
frequency, the wavelength of WDM (Wavelength Division 
Multiplexing) or the like, however, the method is not 
restrictive as long as a plurality of paths can be 

15 distinguished. 

[0055] Fig. 9 depicts a case that paths are 

distinguished by the LSP of an MPLS network. The MPLS 
network generally comprises a label edge router (Label Edge 
Router/LER) and a label switching router (Label Switching 

20 Router/LSR) connected to each other. The label edge router 
is provided at the outer circumferential portion of the 
MPSL network, and serves to receive packets from an 
external network or terminal and transfer the packets into 
the MPLS network, and transfer packets received from inside 

25 the MPLS network to an external network or terminal. The 
label switching router is located inside the MPLS network, 

* 

and serves to transfer packets received from the label edge 
router or another label switching router to another label 
edge router or label switching router. 
30 [0056] The LSP that is the path to which packets are 

transferred in the MPLS network is set up along with a 
series of label edge routers and label switching routers 
with the label edge router (Label Edge Router/LER) at the 
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entry point of the MPLS network inlet port as the starting 
point, and the label edge router at the exit of the MPLS 
network as the termination point. Generally, packet 
transfer acquires information, such as an input interface 
5 and a destination IP address, of a packet, searches a path 
control table based thereon in a label edge router, and 
classifies the packet into each transfer class (Forwarding 
Equivalence Class/FEC) . 

[0057] Next, after searching for the interface that 

10 should output the value of the label corresponding to each 
transfer class, and a packet, the second layer address of 
the OSI reference model of the label switching router of 
the next hop or the like, and encapsulating the packet by 
the MPLS header and the second layer header based on those 

15 information, the packet is transferred to the corresponding 
label switching router of the next hop. What is necessary 
is to perform load distribution in the MPLS network using 
the present invention, to install the load balancer that 
has the path control apparatus according to the present 

20 invention at, for example, the entry point of the MPLS 

network, and to set a plurality of label switching paths 
which have the apparatus as the starting point with respect 
to a transfer class which is to be subject to load 
distribution. Accordingly, the packet classified into an 

25 arbitrary transfer class can be classified and transferred 
to the group corresponding to each label switching path 
based on the weighting factor thereof. 

[0058] Although the example which associates a plurality 

of label switching paths with one transfer class has been 
30 explained above, it is possible to associate one label 

switching path with one transfer class. In this case, each 
group and a transfer class are associated with each other 
in 1 to 1 , and the group classification can also be 
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performed, at the same time, based. on a weighting factor in 
the step of classifying an input packet into a transfer 
class . 

[0059] The location at which the load balancer is 

5 installed is not restricted to the entry point of the MPLS 
network. That is, it is possible to perform load 
distribution among a plurality of label switching paths 
extending to the outlet label edge router with the load 
balancer as the starting point by placing the load balancer 

10 in that label switching path which starts at an arbitrary 
entry label edge router and ends at the outlet label edge 
router, setting a plurality of label switching paths which 
have the load balancer in the middle of the label switching 
path which extends to the outlet label edge router with the 

15 load balancer as the starting point. Accordingly, when the 
quality of an arbitrary label switching path deteriorates 
in the middle of a path, it becomes possible to assign a 
flow to another label switching path automatically, and the 
network utilization factor can always be kept high. 

20 [0060] Fig. 10 depicts a case that a path is 

distinguished through the virtual connection of PPP . PPP 
is the protocol of the second layer of an OSI reference 
model, and, the virtual connection generally connects two 
adjoining nodes. When an arbitrary node is the end of a 

25 plurality of PPP connections, it is generally possible to 
clearly identify the packet that belongs to each virtual 
connection. Namely, when transmission media differ for 
every virtual connection, or when a plurality of virtual 
connections are set up through the same transmission medium 

30 like PPPoE (PPP over Ethernet (registered trademark) ) , a 
unique set of (a sender MAC Address, a destination MAC 
Address, and a session identifier) can be assigned for 
every virtual connection . 
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[0061] The case that one customer connects to a 

plurality of service providers simultaneously, and connects 
to a network therethrough as an example of the load 
distribution which uses such a PPP virtual connection will 
5 be explained as an example. To simplify the explanation, 
it is given on the assumption that a customer and each 
service provider are connected through one PPP virtual 
connection, respectively. That is, the load balancer that 
a customer owns has been connected to the remote access 

10 servers of a plurality of service providers through 
different PPP virtual connections, respectively. 
[0062] In the above case, one group can be assigned to 

each service provider, and the corresponding ratio of 
weighting factors can be adjusted according to the use 

15 bandwidths toward the respect providers. That is, when one 
service provider is crowded and the service provider of 
another side is vacant, the flow which goes to the crowded 
service provider can be automatically assigned to the 
vacant service provider. Accordingly, it is possible to 

20 efficiently transfer packets to service providers even 
under the situation where the congestion of service 
providers changes from time to time. 

[0063] Fig. 11 depicts a case that the VP or VC of the 

ATM is used. The VP or VC of the ATM can be used to 

25 connect, for example, between routers. Following is an 

explanation, as an example, of the configuration where two 
paths of going to an arbitrary but same destination from 
the load balancer exist, and are connected with the routers 
of the next hops of the paths by different VPs or VCs, 

30 respectively. In the case, the traffic which goes to the 
same destination in the load balancer can be classified 
into two groups, and the weighting factors for the 
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respective groups can be adjusted based on the result of 
measuring the respective use bandwidths . 

[0064] Even if a failure occurs in either the VP or the 

VC, and arrival at the same destination becomes impossible, 
the weighting factor for the other one of the VP and VC 
increases automatically, so that a flow can be moved from 
one path which has the failure to the other path which has 
no failure. The same destination is not necessarily 
restricted to the last arrival point of a packet, but the 
point where a plurality of paths to the network which are 
to be passed en route are present can be considered as the 
same destination. 

[0065] Fig. 12 depicts a case that a path is 

distinguished using the VLAN of IEEE 802. 1Q. For example, 
when a packet can reach the same destination via a 
plurality of VLANs , each VLAN can be taken as one path. In 
this case, it becomes possible to transfer traffic, 
efficiently using each VLAN by assigning a weighting factor 
to each path, measuring the traffic which passes through 
each VLAN, and adjusting each weighting factor based on the 
result . 

[0066] Fig. 13 depicts a case that a path is 

distinguished based on the node of the next hop (when 

interfaces differ physically) . A node herein points out a 

general thing with the function of transmitting, receiving 

or transferring a packet based on the information on a 

network layer (or data link layer) . The next hop is a node 

to be passed next as observed from an arbitrary node on the 

» 

path which transfers a packet to the destination from the 
sender. As an example, the following will describe a case 
that the router of the service provider is connected to a 
plurality of other service providers through IX (Internet 
exchange) . 



[0067] When a plurality of service provides are 
selectable as the next hop for a packet to arrive at the 
same destination network, it is possible to perform load 
distribution on the path that goes through the service 
5 providers using the path control method according to the 
present invention. When the structure of the IX is such 
that the routers of the individual providers are connected 
around the core switch of a data link layer, the IP address 
of the node of the next hop and the data link layer address 
10 corresponding thereto can be used as specific means for 
identifying a path. 

[0068] By classifying packets addressed to the 

destination network into groups of a plurality of paths, 
measuring the use bandwidths for the groups, and reflecting 

15 the measurements on the values of weighting factors, when 
the quality of each path changes with time, it is possible 
to transfer traffic always using the resource of each path 
effectively. For example, when the quality of the path 
which goes through an arbitrary service provider degrades, 

20 the flow passing therethrough can be promptly assigned to 
the path which goes through other service providers 
automatically. On the contrary, when the path which goes 
through an arbitrary service provider is less busy than 
other paths, a flow can be .automatically assigned to the 

25 less-busy path from the other paths. 

[0069] When a failure occurs in the provider in the 

middle of an arbitrary path and arrival at a destination 
network is stopped, a congestion-control function works at 
the connection of the TCP which goes through the path and 

30 the throughput deteriorates quickly. Therefore, it becomes 
possible to avoid the failure promptly by measuring that 
and updating the weighting factor. It is particularly 
important that the load balancer autonomously performs such 
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a load-distribution function and a failure evasion function. 
That is, path control can be performed based only on the 
information acquired from the traffic which passes the load 
balancer, without acquiring any path information and 
5 failure information from other routers, servers, or the 
like. 

[0070] Although the foregoing explanation of the example 
has been given of the case that a single provider uses the 
load balancer, a plurality of providers can use the 

10 respective load balancers in parallel. Furthermore, 

although the foregoing explanation has been given of the 
load-distribution processing being executed for a single 
destination as an example, it is also possible to 
simultaneously perform load-distribution processing on 

15 another destination while performing load-distribution 
processing to the arbitrary destination. 
[0071] Furthermore, the target to which the load 

balancer distributes traffic is not limited to a path of 
the same kind. For example, even in a case that three 

20 paths which can reach the same destination exist, the first 
path uses the label switching path of the MPLS, the second 
path uses the virtual connection of the PPP , and the third 
path is connected to other routers using the VC of the ATM, 
load distribution among these paths is possible. The 

25 reason is because the path control method and apparatus 
according to the present invention are not dependent on 
specific means of each path, as long as the use bandwidth 
of the traffic which passes the load balancer can be 
measured with respect to a plurality of arbitrary paths. 

30 [0072] The flow management method in the flow 

classifying unit 1 will be explained next with reference to 
Fig. 14. Fig. 14 is a flowchart of the flow management 
method. In the present embodiment, when the ratio of 
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weighting factors, Wll:W12, changes, movement of the flow 
between paths occurs. When there is a difference in time 
delay between two paths at this time, the sequence of the 
packets belonging to the same flow can change on the way. 
5 For example, when the TCP or the like is used, changing of 
the packet sequence within the same flow can cause 
degradation of the performance. 

[0073] As shown in Fig. 14, even when a weighting factor 

changes, the flow classifying unit 1 performs management in 

10 a way that packets belonging to the same flow can surely 
pass along the same path. In the method, a flow storage 
table 7 is provided, and the flow to which the passing 
packet belongs and the path assigned to the flow are 
registered in association with each other. First, when a 

15 packet is input, the flow storage table 7 is referred to 
check if a flow to which the packet belongs has already 
been registered (step 110) . Consequently, when the flow 
has already been registered (step 111: YES), the packet is 
classified into the group corresponding to the flow (step 

20 112) . On the other hand, when the flow is not registered 
(step 111: NO), the packet is classified into the group 
whose weighting factor needs to be increased, and the 
corresponding flow and group are newly registered into the 
flow storage table 7 (step 113) . 

25 [0074] Fig. 15 is an example of the flow storage table 7 

when a TCP connection is used as a flow. A flow is 
identified with four numbers, namely the sender address, 
the destination address, the sender port number, and the 
destination port number, as an identifier, and an output 

30 group is associated therewith. In the example, the packet 
whose flow identifier is {SIP1, DIP1 , SP0RT1, DPORT1} is 
classified into Gil, and the packet whose flow identifier 
is {SIP2, DIP2, SPORT2, DPORT2 } is classified into G12 . 
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When the flow identifier of an input packet matches with 
any of them, the packet is classified into a corresponding 
output group. When the flow identifier of an input packet 
matches with none of them, the packet is classified into a 
5 group whose weighting factor is to be increased. 

[0075] Fig. 16 is an example of a flow assignment table 

8 which can be used at the time of determining into which 
group an unregistered flow is registered. In the flow 
assignment table 8, the current weighting factor (the 

10 current value of the registered number of flows) and a 

target weight (the target value of the registered number of 
flows) are associated with each other for each group. 
Assuming that the ratio of weighting factors W11:W12 is 1:2, 
a packet whose flow identifier is {SIP1, DIP1 , SPORT3 , 

15 DPORT1 } is input, the corresponding flow identifier is not 
registered in the flow storage table 7 of Fig. 15. With 
reference to the flow assignment table 8, it is understood 
that the current weight of G12 is smaller than the target 
weight. 

20 [0076] Therefore, this packet is registered into G12, a 

new flow identifier {SIP1, DIP1, SPORT3, DPORT1) is 
registered into the flow storage table 7 in association 
with the group G12, and the number of registered flows 
corresponding to the group G12 is increased by 1. For 

25 example, in the current Internet, the average sustaining 

* 

time of a flow is several seconds, and sequential execution 
of the method can permit the number of flows proportional 
to the weighting factor to be output to each path, without 
changing the sequence of packets that belong to the same 
30 flow. An aging timer can be used to cancel registration of 
old flows in the flow storage table 7 . 
[0077] 

[Effect of the Invention] 
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According to the present invention, as explained above, 
flows of input packets are classified into respective 
groups based on preset weighting factors thereof, the flows 
are output to different paths for the groups, that of 
5 bandwidths used in the paths which is used by each flow is 
measured group by group, and the weighting factor of each 
group is adjusted based on the ratio of the unit use 
bandwidths. Therefore, the bandwidths to be used by flows 
passing through the individual paths are averaged, thus 
10 making it possible to dynamically optimize the distribution 
of traffic over a plurality of paths in a network, so that 
network resources can be used efficiently. 
[Brief Description of Drawings] 

[Fig. 1] A schematic configuration diagram of a packet 
15 transfer system to which a path control method according to 
one embodiment of the present invention is adapted. 
[Fig. 2] A concept diagram of a plurality of paths. 
[Fig. 3] A block diagram of a configuration example of a 
load balancer. 

20 [Fig. 4] A flowchart of a path control process in the load 
balancer . 

[Fig. 5] An explanatory diagram of an example of an 
adjustment method for weighting factors. 

[Fig. 6] An example of packet classification when a fourth 
25 layer connection of an OSI reference model is taken as a 
flow. 

[Fig. 7] An example of packet classification when a third 
layer address of the OSI reference model is taken as a flow. 

[Fig. 8] A configuration example of a flow classifying 
30 unit that classifies packets with a hash function. 

[Fig. 9] An example of packet output when a path is 
distinguished with LSP of an MPLS network. 
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[Fig. 10] An example of packet output when a path is 
distinguished with a virtual connection of PPP . 
[Fig. 11] An example of packet output when a path is 
distinguished with a virtual connection of an ATM network. 
5 [Fig. 12] An example of packet output when a path is 
distinguished with a VLAN identifier of a VLAN network. 
[Fig. 13] An example of packet output when a path is 
distinguished with an output physical interface. 
[Fig. 14] A flowchart of a flow management method. 
10 [Fig. 15] A configuration example of a flow storage table. 
[Fig. 16] A configuration example of a flow assignment 
table . 

[Explanations of Letters or Numerals] 

Nil Packet transfer network, Bll ■•• Load balancer 

15 (Path control apparatus), Rll, R12, R13 •■• Router, Til, 
T12, T13 Terminal, Pll, P12 ••■ Path, Gil, G12 

Group, Wll, W12 Weighting factor, BW11, BW12 Unit 

use bandwidth, N12 • • • MPLS network, N13 • ■ ■ PPP network, 
N14 ••■ ATM network, N15 VLAN network, N16 ••• Network 

20 of physically divided path, 1 Flow classifying unit, 2, 

3 • • ■ Flow output unit, 4 • • • Bandwidth measuring unit, 5 
••• Unit bandwidth calculator, 6 •*• Weighting factor 
adjusting unit, 7 • • • Flow storage table, 8 • • • Flow 
assignment table . 
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[Fig. 1] 

Nil Packet transfer network 
Til, T12, T13 Terminal 
Rll, R12, R13 Router 
5 Bll Load balancer 

[Fig. 2] 

Til, T12, T13 Terminal 
Bll Load balancer 
10 Pll, P12 Path 
R13 Router 

[Fig. 3] 

1 Flow classifying unit 

15 2,3 Flow output unit 

4 Bandwidth measuring unit 

5 Unit bandwidth calculator 

6 Weighting factor adjusting unit 
Pll, P12 Path 

20 Gil, G12 Group 

[Fig. 4] 

100: Classify flows into groups based on weighting factors 
101: Output flows to paths corresponding to groups 
25 102: Measure bandwidth for each path 

103: Calculate bandwidth per unit weighting factor 
104: Adjust weighting factor 

[Fig. 5] 

30 Weighting factor for each group 

Weighting factor Wll for group Gil 

Weighting factor W12 for group G12 
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When bandwidth per weighting factor is BW11>BW12, increase 
Wll 

When bandwidth per weighting factor is BW11=BW12, Hold Wll, 
W12 

5 When bandwidth per weighting factor is BW1KBW12, Increase 
W12 

[Fig. 6] 

Fourth layer connection 
10 1 Flow classifying unit 

Classify fourth layer connection of OSI reference model 
into groups based on weighting factors 
Gil, G12 Group 

15 [Fig. 7] 

Third layer address 

1 Flow classifying unit 

Assume a sequence of packets in which at least 
sender /destination address of third layer of OSI reference 
20 model is identical as a flow based on weighting factors, 
and classify the packets into groups 
Gil, G12 Group 

[Fig. 8] 
25 Input packet 

Address, port number 

21 Hash value calculator 
Hash value 

22 Hash value group classifying unit 

30 

Packet with hash value of 4 to 9 
Packet with hash value of 1 to 3 
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To group of path Pll 
To group of path P12 



[Fig. 9] 
5 Gil Group 

2 Flow output unit 

Output packets affixed with label corresponding to path Pll 
MPLS network 

10 

[Fig. 10] 
Gil Group 

2 Flow output unit 

Output packets affixed with identifier corresponding to 
15 path Pll 

Virtual connection 
PPP network 

[Fig. 11] 
20 Gil Group 

2 Flow output unit 

Output packets affixed with identifier corresponding to 
path Pll 

Virtual connection or virtual path 
25 ATM network 

[Fig. 12] 
Group Gil 

2 Flow output unit 
30 Output packets affixed with VLAN identifier corresponding 
to path Pll 

VLAN network 
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[Fig. 13] 
Group Gil 

2 Flow output unit 
5 Output packets to node of next hop corresponding to path 
Pll 
Path 

Network with a path branched by node of next hop 

10 [Fig. 14] 

7 Flow storage table 

4 

110 Search when flow to which packets belong has already 
been registered 

111 Is flow registered? 

15 112 Classify packets to registered group 

113 Classify packets to group whose weighting factor is to 
be increased, and register flow 

[Fig. 15] 
20 7 Flow storage table 

Flow identifier Group 

Sender address 
Destination address 

25 

Sender port number 
Destination port number 

[Fig. 16] 
30 Flow assignment table 

Group 
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Current weight (Current value of registered number of 
flows) 

Target weight (Target value of registered number of flows) 
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^0 [0 0 5 5] H9T*li. MP L S"*y h 17 — ^ CO L S P 

y — ^li. — j»l^, 7 ^</W3i y v?/U— ^ — (Label Edge 
Router/LER) 7^/^^7f/^^ (Label Swi 

tching Router/LSR) b&s 

Tl^, ww-C, y^/U^-y v?/W— li, MPLS* 

fcr±*5K*»P>^y hSrSIILTMPLS^y h7-^ 
rt(^^ry H^rteaiUfcD. MPLS* y h 17 — ^ f^j0|S 
d^oattlfc^y h4r^tto*y h7-^«^ 
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12s MP L h 17 — ^ftgBlC&^U 7^7*^ 

A— * -KiSi- 6 ill # S:»o 0 

[0056] MPLS^y h V — ? \Z&\,^X'*4r *y 
^i££ft£S£S&Tfc£LSPI*, MPLS^yhy^^ 
AP^7^X2/'^-^- (Label Edge Router/LE 
R) L N MP LS*^ M7 — ^P07^x 

"T\ '<tr y h<DAtl^ — 7 I PT KU 

l"C, / <J T y h^r^S-K^^^^ (Forwarding Equivalen 
ce Class/FEC) d^lg-f 5 0 

[0 0 5 7] ^^{Cttfc'tZ^^W 
fit, FtffiAt^^^-7x^^, fc**^ 

^^^/V^^ y^As* — ^ — COO S I J\"W> 2 MT 

[0 0 5 8] ±lETte, lo^teSI^7^lC*rb-caft 
60 7 ^/v ^^fyf^t #JCS# 6 M tc o v > T Bt 91 U fc 
7$$. 1 o 7^(-^LT 1 oco^^/i^-f y^v< 

[0059] ±e*ff&ttttB*ini-«*j?r 

tt N MP L S** K^-^coAPlHS^i-PR^^^T^i^ 

v\, fft*^. fitoAP 7^3: 

9 fcB q 9 -^A'sc y t*^*>67'</W*>r y^v* 
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[0 0 6 0] *tz s ISlOtMi* PPPCOiHiB^^^v' 
s ^&&£10'H-£^£^LT^6 0 PPPIiOS 

<D-e&% 0 fit o y - K^IS<7) ppp=2^^i/ 3 yo 

70 £\ *>*VM*P P P o E (PPP over Ethernet 

at) ) o*?^ n-<oeasjBt#4r^ux**o«a=i 

vr^i:®^ {i^TcMACT K^^s 36ftMAC7K 
<fe><5 0 

[0 0 6 1 ] ^(Oct ?&P P P(EB = ** >s ^Srftffl 
[0 0 6 2] ±I5^T— #t-t^7 P nyW^ 

lcifp]^5 70- ^v^rv^t- yfxT'v^'fjftDjj 

«JC*3V^t, «-t-^7 p p/M^LT5S$«J:< 

[0 0 6 3] Ml 1 T'it ATMOVP^fcliVC^ 
/8-r5»&4r^L-CV , >5o ATM(OVP*fcliVCIi, 

* — tf-t Jh,<?ix£ ft S v P * tz it V c tc J; «9 £ ixT 
v^5«/KSrWt LtRWtS, ±l5^-^-C«, 

[0 0 6 4] ^mcj;^. Wx.(jf— ^(^V P^fcfiVC 
50 § BbWt-<i!l*o v P * fi v c izM^ 5 a^«*A s Wjp 
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[006 51 Bl2tlt IEEE8 0 2. 1QCQVL 
icfctK «• v L A N Sra*ftWW U t h 7 7 ^ ^ ^ * 

cars a* prist **• 

[0 0 6 6] Ell 3T*li. ^O^^^O/- Kfc£<5# 
SB&K8tfi-*»& (»Ittlt-f — 7x^ 

<£1C<D1J— tf^yo/^xf ^<0)V— I X (Internet e 
Xchange) tT^^o ^ 

[0 0 6 7] /<4rjy hdSRI— 3SJfe*y — ^tcPJii-r 

[0068] ±GAft^^ yy—t ^'foxt^'r v v 

*£fc»*:7n— fcjt^lcte©*— 
tr^ y<4 ^SrS*i-S»K^ i ftMlcfi !9 fatt 5 £ 

[0 0 6 9] £fc, ffiSOiSBcO^^^^a/^^^tclW 

^sna^Fie t * o 
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[0 0 7 0] ±IBLfefiRI"Ctt, ^n./<^^^±IE^ 

. ffi&mDim&mt ^xm.wviz&. ftto^^s 

[0 0 7 1] £fc. ±|B*W^fkagBd5 F77^^H 

Bj&M¥SEU 1 (Z)g^liMP L S W7^^-f y 

V£rffiffiU ^3 COSSS^ ATMCOVC^fflttlO 

#L&V^<bT£>£o 
30 [0 0 7 2] fcl^ il4^#ilt, 7P^I^1 

fi^Wft^JtWl 1 : Wl 2 3&S^bUfce#(Cl, a 

^ [0 0 7 3] *:rT\ 11 1 4 (d^i-J: 9(C 7n^| 
$|5l|Cfc^T, l^ffft * 5 «<b L fc 1^ - 7 p - 

Izmir*'**!/ hjftSiKrw— «t ^t-^-f 
So ^OT^&T-ti, 7n- y^7^:IS:itT, ii 

tfxtjTzts 7d- fsti^— ^y^itx^y 

1-6 (^7^1 10) o 7n-3ft5|JE^«» 
$tbrv^S»*tC^i Uf^7'l 1 1 : YES) > *zV) 

50 yv—^tt&l-z?^— rf\r.^*y Y%:'dW1rZ> (^r- 
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^112), — 7P-^l^$hTV^jJV>4|^IC 

11 : NO) , S^&£if/fn£ii:*:^ 

^113). 

[0074] 12)1 5 id. 7D-i:UTCP='^^«>3 
;:ixlc»U-CHJ2j*/V'— ^*s»JS#it6)ixrv^ 0 ceo 

Wtftt, V d — gftE'J^ (SIPl, DIPl, SPO 
RTl, DPORT1) UZ>'<*rv hliGl 1 

7 n — g&B'J^-ri 5 (SIP2, DIP2, SPORT 
2, DPORT2) y M4G 1 2\Z#m£tl 

£ e xji'<>ry h<D^a— nM^-a*, m^<?)V^ftl^ 

[0 0 7 5] Hi 6ICli|^nTV^/ < fV>7D- £r£*<0^ 

sis— yiz&m-fzfr&ymirzmcm^z n £ ^-c# s 

9iamt5lH^5 0 l^tOl:bW 1 

1 : Wl 2^1 : 2t'fcS^Kl, SfcBiR- {S 

I P 1 , DIPl, SPORT3, DPORTll /«£ 5 

ClT?;7a— «0 ^T^ — 7 JVS G12<D 

So 

[0 0 7 6] U:^oT, :^y^G12Cli 
-TSi tfcJC, STrUV^o— »»U^ {SIPl, DIP 
1, SPORT3, DPORTll ^W/G 1 2 

o-»9Stf-^8© % :/G 1 2M*j-j£i-3 

8»7P-»S:liMlIt5o S^E^V* — * 

^ htli, 70— <o^*S«FlKa#Mtt*»-efc!3, ±xii<o 

7D- lEt&T 1 — 7'/W7H v?^^^-Y^— SrfiJ 
[0 0 7 7] 
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;i--^©7P-i:aK^v-/rti:R45gB^iaA 
h!7 — F77^ 

/o mm-rzzk&xzz. 

[Hi] **M<D-j|»©?KfflJC3&^5a»f6«J»^iSfe 

[13] ^WMSfiOW^^t^P y^BI"Cfc 

So 

20 IBs] m*mw<om&%fem*7FirWRm-Qihz>o 

[H)6] OS 1 #RS^e-7 :? ^<D^4^=i^^ v-3 
I® 7] OS I #RB^-7Vl'(OfS3/f T KU^S:7P- 
[IH8] /Ny>»BB*t?^y h*»at5 7P-» 
im9] MPLS^y h!7 — ^(OLSPT«$rra 
[IUI 0] P P PO(E3B=»*^ >T*SSSSrES'J-r 
im 1 1 ] ATM^y h 17 — ^C0(RSv=J^^ > 3 >"C 
lIUl 2] VLAN^y h !7 — ^ CO V L ANpIS'JT-T* 

[mi 3] ibfimm^ ~j *x-m&*&$\~r 
[mi 4] 7 v—'wmjjfe&^i-y k-^ 
[mi 5] ibh^— ^K0«dtWi"e*>5 o 

^0 11)16] 7 p-91 0 a T7-^i«M-C*)5« 

[^colft^] 

N 1 1 ■ y hUSk* y yy — v- , Bll -Affif^fk 
^© (jSKflHJ103£(E) > R 1 l , R 1 2, R l 3 - 

Til, T12, Tl 3-«S*. P 1 1 , P12- 
Gil, G 1 2---JOU— 7\ Wl 1, Wl 
3f«»C, BW1 1, BW1 2-*fitffifflffir««. Nl 2 
■;-MPLS*y H7-^, N 1 3 — P P y h 17 — 

N14-ATM^y h!7-^ N15-VLAN^ 
y yy — V, N 1 6--*l3ffiWtcgK^»A^fc^y N ^ 
50 l-7D-m 2, 3-7o— tb^Dffi, 4 — 
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